KURAM VE UYGULAMADA EGiTiM BiLiMLERi EDUCATIONAL SCIENCES: THEORY & PRACTICE 


Received: December 2,2015 

Revision received: February 23,2016 Copyright © 2016 EDAM 

Accepted: March 28,2016 www.estp.com.tr 

OnlineFirst: April 20, 2016 DOI 10.12738/estp.2016.3.0392 ♦ June 2016 ♦ 16(3) ♦ 827-848 

Research Article 


How Powerful is Feedforward in University Education? 
A Case Study in Romanian Geography Education on 
Increasing Learning Efficiency 

Maria Eliza Dulama 1 2 Oana-Ramona Ilovan" 

Babe$-Bolyai University Babe^-Bolyai University 


Abstract 

There are different opinions about the meaning of feedforward: some consider it a response to feedback, 
while others think it consists of suggestions given to a person in order to help them before learning or 
starting a task. This study analyzed the professor’s and university students’ actions during a seminar activity 
with a group of 60 students from Babe§-Bolyai University in Cluj-Napoca, Romania and represented them 
in a flowchart. It also analyzed the efficiency of several didactic techniques and tools that were used with 
the role of feedforward (e.g., task, checklists). Students’ results in the form of sketch maps were compared 
with the ones from a control group of another 60 students from the same university; the methods and tools 
that were used as feedforward were noticed to determine an increase in efficiency and better product quality. 
The feedforward categories were systemized and described, thus filling a gap in the literature of the field. 
To increase students’ learning efficiency and the quality of their results, professors should use feedforward 
more than feedback, because this creates and ensures the necessary conditions for students to correctly solve 
tasks and to prevent them from making mistakes. 
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Theoretical Background 

Professors in the Romanian university system plan and organize their activities 
under the assumption that their students have the subject-specific competences 
mentioned in the school curricula for the geography class in the pre-university 
education system or from previous years of university studies. In reality, these 
students do not have all these competences developed at a superior level, and this is 
the reason they have difficulties when solving tasks. Frequently, professors notice this 
situation rather late, after students’ involvement in the learning process. At this point, 
professors cannot change any results and are only able to offer feedback (Cathcart, 
Greer, & Neale, 2014). 

In order to prevent students from failing and to fill in the gap between students’ 
necessary knowledge or the competences that professors expect and the real ones that 
professors actually use, there are diverse educational tools beside the ones from their 
pedagogical discourse: tests, questionnaires, checklists, worksheets, study guides, 
instructions, protocols, tutorials, examples, glossaries, and so on. When planning 
activities and educational tools, professors should anticipate students’ problems when 
learning and should find appropriate ways to formatively intervene. In order to solve 
the problem by increasing students’ success rate and diminishing failure, this study 
looked for the best educational mechanisms and tools for professors to use during 
their students’ learning process during courses and seminars as well as apart from 
these fonnal activities, not after students have finished learning. Some researchers 
consider feedforward to be such a prevention mechanism (Baker & Zuvela, 2013; 
Cathcart et al., 2014; Goldsmith, 2008), but opinions about how to use it differ 
(Duncan, 2007; Gibbs & Simpson, 2004; Flemandez, 2012; Koen, Bitzer, & Beets, 
2012; Murtagh & Baker, 2009). 

During activities, professors often empirically use both feedback and feedforward. 
In opposition to feedback, feedforward is a controversial subject that has been paid 
little attention in educational research. So that professors are able to use feedforward 
from a scientific perspective, this study performs an exploratory research by finding 
proof for the use of feedforward in comparison with feedback; it also utilizes a 
quasi-experimental research to test certain tools with a feedforward role. Direct 
observation, documents, and findings were observed in order to draw a series of 
theoretical conclusions about feedforward. 

Understanding and explaining feedforward has been enabled through a series of 
studies on feedback that focused on presenting the concept (Flattie & Timperley, 
2007; Fliggins, Flartley, & Skelton, 2001; Lyster & Ranta, 1997), its importance 
during learning (Brown, 2004; Brown, Flarris, & Flamett, 2012; Clarke, 2003; Flattie 
& Timperley, 2007; Pajares & Graham, 1998), the receiver (Fliggins et al., 2001; 
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Irving, Harris, & Peterson, 2011; Wiggins, 2004), the feedback source (Brown et al., 
2012; Peterson & Irving, 2008; Topping, 2010), administration conditions (Brown 
et al., 2012; Hattie & Timperley, 2007), the moment of giving feedback (Hattie & 
Timperley, 2007), the methods of giving it (Koen et al., 2012), typology (Fink, 2007; 
Harris, Brown, & Harnett, 2014; Hattie & Timperley, 2007; Irving et al., 2011; Mori, 
2011; Murtagh & Baker, 2009; Shute, 2008), its impact (Brown, 2004; Gibbs & 
Simpson, 2004; Koen et al., 2012), and its efficiency (Akalin & Sucuoglu, 2015; 
Hattie & Timperley, 2007; Irving et al., 2011; Shute, 2008; Topping, 2010). 

The neurosciences have frequently researched feedforward using feedforward 
to trigger: visually selective behavior (Van Rullen & Koch, 2003), the learning 
capability and storage capacity of feedforward networks (Huang, 2003), and the 
changes in feedforward postural adjustments following voluntary motor training 
(Tsao & Hodges, 2007). In lightwave technology, they have researched coherent 
optical communications that use feedforward architecture (Ip & Kahn, 2007). Other 
studies have focused on using feedback and feedforward for scheduling control tasks 
(Cervin, Eker, Bernhardsson, & Arzen, 2002). 

Few studies are found about using feedforward in education (Duncan, 2007; 
Goldsmith, 2008), and researchers have frequently approached it alongside feedback 
(Gibbs & Simpson, 2004; Hernandez, 2012; Koen et al., 2012; Murtagh & Baker, 
2009). Feedforward has two meanings. The first one refers to learners’ actions and 
is described as “a concept that focuses on the responses of learners to feedback” 
(Hernandez, 2012, p. 492). Lyster and Ranta (1997) named students’prompt response 
to professor’s feedback as assimilation, similar to what other researchers have named 
feedforward (Duncan, 2007; Gibbs & Simpson, 2004; Hernandez, 2012; Koen et 
al., 2012; Murtagh & Baker, 2009). Moreover, the “feedforward assessment implies 
that students recognize the goal of feedback and interpret and apply the suggestions 
in order to close the gap between the current level of performance and the expected 
learning objective” (Koen et al., 2012, p. 240). 

The second sense underlines that feedforward refers to the actions of a person who 
gives future suggestions to somebody else because these can significantly help the 
other person and because this person should learn as much as possible (Goldsmith, 
2008, p. 2). Moreover, feedforward provides students with prior exposure to 
assessment and thus helps clarify professors’ expectations and standards (Baker & 
Zuvela, 2013). In addition, in comparing feedback with feedforward, Goldsmith 
underlined several features of the latter: it focuses on the future, not the past; “it is 
almost always seen positively because it focuses on solutions,” to solving tasks, not on 
correcting mistakes; “it cannot involve a personal critique, as it discusses something 
that has not yet happened;” “it can reinforce the possibility of change” (2008, p. 3); 
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“it does not imply superiority of judgment;” and “it tends to be much faster and more 
efficient than feedback” (2008, p. 4). By giving different meanings to the concept 
of feedforward in reference to its source (learner vs. teacher or the one directing the 
learning) or its function (direct connection vs. response to feedback), one can determine 
its misunderstandings and low capitalization of learning. Because “improving the 
quality of education depends on the performance of teachers” (Sencan & Karabul, 
2015, p. 359; Vavra, 2014) in the positive emotional sphere, in active participation, 
and in building upon the experience of the classroom (Klonari & Mandrikas, 2014, 
p. 149), teachers should understand and use feedforward appropriately. By using 
feedforward, students also can have the opportunity to develop their future visions 
as they become active (Artvinli, 2010a). In such a learning-teaching environment, 
teachers can influence the way their students learn and stimulate active learning 
(Artvinli, 2012) based on constructivist theories (Artvinli, 2010b). 

To understand in depth the way to use feedforward as an educational tool, our aim 
is to answer the following question: How can one determine an increase in learning 
efficiency during activities with students and an increase in the quality of results when 
using feedforward? Out of this essential question, a series of other secondary questions 
result: What is feedforward? Who needs it? Who should offer it? Why should anyone 
offer it? When should one offer it? What should it contain? How does one build 
feedback? What are the methods, techniques, and tools through which one can offer it? 
What are its features? What are its categories? How do students regulate their activity 
according to the feedforward? What is its impact? And, what are the limits? 

In order to research feedforward and to answer these questions, a naturalist paradigm 
was used to analyze the professor’s and students’ actions during a seminar activity. 
During this activity, the focus was shifted from the feedback to feedforward method, 
as suggested by Higgins et al. (2001), to help students solve tasks according to the 
professor’s expectations. At the end of the activity, students’ actions were analyzed 
and interpreted to identify the effects of the employed feedforward techniques and 
tools. In the end, the research findings and elaborated models underlined the manner 
in which professors could determine how to utilize feedforward to increase learning 
efficiency and the quality of their students’ results. 

Method 


Design 

This quasi-experimental activity took place in 2015 during a two-hour seminar for the 
Geography and Teaching Geography in Primary Grades and Kindergarten Class at the 
specialisation the Pedagogy of the Primary Grades and Kindergarten Education at the Faculty 
of Psychology and Sciences of Education from Babes-Bolyai University in Cluj-Napoca, 
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Romania. The learning objectives (to perceive correctly the geographical space represented 
on maps and to leam a method of representing landforms), the task (individual drawing of 
a sketch map), and the process stages to be undergone (studying the atlas map, the text, and 
the model sketch; representing the mountainous units, the valleys, the rivers; writing the 
names, title, and sketch orientation; and elaborating the legend) were communicated to both 
groups, the experimental group (EG) and the control group (CG). Students received the 
written text of the task for rereading, maps, a monochrome model sketch of the terrain from 
the textbook (Dulama, 2011, p. 91), and the text for the Task Variant 1 (VI; see Table 1). 
Task VI included 12 written commands in the logical order students should perfonn them, 
and they were correlated with nine indicators (I) from the assessment tool (11-125). 

Students in the EG also benefited from the professor’s feedforward interventions 
while they solved the task. They received Checklist 1 at the end of the activity in 
order to monitor task solving. After the activity, Task Variant 2 (V2) and Checklist 2 
(see Table 2) were e-mailed to the students, as both instruments had been improved 
after the seminar. They used Checklist 2 at home to monitor their solutions to the task. 

Population 

Included in this research were 120 third-year prospective primary-school and 
kindergarten teacher university students. Simple randomization was used to fonn 
two groups, an experimental and a control group of 60 students each, to represent two 
seminar groups. These students represented a sample of the population with similar 
features. They had not solved the researched task before. Under the circumstances of 
anonymity and privacy, students volunteered to participate in the research and to have 
their projects used during the research. Students perceived the primary author of this 
paper as a professor, not as a researcher, which helped to ensure the authenticity of 
students’ actions and the interventions. Elowever, this could have induced a certain 
degree of subjectivity. The heterogeneity of groups according to gender and age was 
not relevant to this research, but their knowledge level and competence in geography 
might have influenced the research findings and its generalizability. As this quasi- 
experimental study took into account only one faculty and a small number of subjects, 
it is possible that statistical data do not represent any student population or sample 
from the respective field of specialization; some of the conclusions might be limited. 

Data Collection and Processing 

For collecting behavioral (professor and student actions in the EG) and verbal 
(professor and student assertions, questions, and answers in the EG) data during the 
seminar, the participatory observation method and an observation sheet were used. 
The behavioral data is presented in Figure 1. A qualitative analysis of verbal data was 
performed through a systematic study of the conversation organization. 
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The 120 sketch maps from the students in the two work groups were assessed, 
and simple randomization was used for choosing which ones to elect for assessment 
through an analytical assessment tool with a dichotomous scale (Table 5). Researchers 
have used grids, such as in Table 5, to identify mistakes in column charts (Osaci- 
Costache, Dulama, & Ilovan, 2013 b) and in touristic plans (Osaci-Costache, Dulama, 
Alexandra, & Voitovici, 2013) for assessing the level of competence when elaborating 
topographical profiles (Osaci-Costache, Dulama, & Ilovan, 2013a) or when elaborating 
choropleth maps combined with diagram maps (Osaci-Costache, Cuco§, & Cuco§, 
2015). The method of content analysis, which is useful for assessment, was used 
(Dulama & Ilovan, 2015). The tool included six assessment criteria and 25 indicators 
correlated to the questions from Checklist 2. In comparison to the tools in the 
published research that have been presented so far, whereas researchers had awarded a 
certain score for each criterion, 2 points were awarded for each correct representation 
correlated to a certain indicator, 1 point for a partially correct representation, and 0 
points for an incorrect representation or one lacking its respective element. One sketch 
map could be awarded with a minimum of 0 points and a maximum of 50 points (range 
being 50), and a minimum of 0 mistakes and a maximum of 25 (range being 25). 

Data processing used descriptive statistics. The total number and the mean number 
of points for each paper, the total number of mistakes and deficiencies, as well as 
their mean value, were computed using this method. For each indicator and for each 
group, the total number of points and the mean value were computed, as were the 
total number of mistakes and deficiencies. In order to test the differences of means for 
the map scores and the errors between the two groups, the independent sample t-test 
was used. In addition, in order to have a qualitative interpretation of the magnitude of 
differences between groups, the effect size of each comparison was computed in term 
of Cohen’s d (the standardized difference between the means). 

In this research, it was important that the research tool had content validity because 
the indicators associated with the assessment criteria showed the quantitative and 
qualitative representation of all components in the sketch maps and ensured objectivity 
of assessment. Moreover, it was relevant that this tool had construct validity because it 
included the essential features of the concept of map: “a precise, generalized, reduced, 
conventional, graphic representation of a terrestrial surface on a plane surface which 
shows the interdependency between the natural and social phenomena at a certain 
moment” (Osaci-Costache, 2008, p. 73). As opposed to maps, sketch maps do not have 
to be precise. The difficulty coefficient that was computed for each indicator and for 
all students varied between 13.33% and 91.67%. For three indicators, the percentage 
was below 25%, but they were not eliminated because the assessed aspects (i.e., peaks, 
depressions, rivers) were essential for representing the landforms. This coefficient 
showed where students had greater difficulties and needed feedforward. 
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Research Material 

In order to answer the research questions about feedforward, the following were 
analyzed and interpreted: professor’s products (Tasks 1 and 2, Checklists 1 and 2, 
and the assessment tool of the sketch maps that students realized [presented in Table 
3]), behavioral data (professor’s and EG students’ actions during the seminar [Figure 
1]) and verbal data (professor’s and EG students’ assertions, questions, and answers) 
that were written on the observation sheet, and the students’ results (i.e., sketch maps 
[Tables 3 & 4, and Figure 2]). 


Findings 

The following material presents the professor’s products, professor’s and students’ 
actions in the EG, and students’ results. Task V1 (Table 1), having the role of feedforward, 
included 12 commands and correlated with nine indicators (36% of the total) from 
the assessment tool. The phrasing of Task V2 was improved with 23 more pieces of 
information, which reached 32 commands and correlated to 14 indicators (56%) from 
the assessment tool, 5 more indicators compared to Task VI (an additional 20%). 


Table 1 

Task VI _ 

Represent on a sketch map the Northern Group of the Eastern Carpathians similar to the model from the 
course material: 1. Represent the mountains with a thick brown line (II). 

2. Mark three main peaks using small black circles (15). 

3. Write the elevation of those peaks (16). 

4. Write the names of those peaks (117). 

5. Draw the rivers with thin blue lines (Ill). 

6. Write the names of the mountains and of the depressions with black capital letters (114). 

7. Write the names of the rivers (116). 

8. Elaborate the legend. 

9. Give a title to the sketch (119). 

10. Mark the north direction with an arrow (121). 


Checklist 1 has 16 questions correlated to 12 indicators from the assessment tool 
(48% of the total), which is 3 indicators more than in task VI. Because of space 
restrictions, it has not been included, but its content is visible through the regular font 
style (italics excluded) in Checklist 2. 

Checklist 2 includes 31 questions correlated with 14 indicators, similar to Task V2 
(56%). It also includes 13 questions which were not correlated to the indicators but 
were useful for task solving. Out of the four tools, Checklist 2 has the most pieces 
of information correlated to the indicators. Task V2, because of space restrictions, 
has not been included in this paper. However, the content of Checklist 2 offers 
information about its content. 
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Table 2 
Checklist 2 

1. Did you place the A4 format paper in a landscape position? 

2. Did you place the sketch in the centre of the sheet ofpaper? 

3. Did you leave enough space for the title and legend? 

4. Did you take into account the size of the mountainous group in the E-W and N-S directions so that the sketch 
would be similar to the size on the map? 

5. Did you draw the 1mm thick brown lines oriented along the main crest of each mountain and long enough 
in order to replicate its reality? (II) 

6. Did you draw the brown lines by uniting the main peaks and taking into account the watershed, so that 
the rivers flow from the crest towards different directions? 

7. Did you write the names of the mountains with black capital letters above the brown lines? (114) 

8. Did you abbreviate the word mountains to MXn.l(II5) 

9. Did you verify whether or not you had represented mountainous sub-units from other mountainous groups? 

10. Did you represent three main peaks with small black circles ? (15) 

11 .Did you abbreviate the word vaif (peak) to Vf (this abbreviation is specific to the original Romanian)? (115) 

12. Did you write the height of the peaks? (16) 

13. Did you write the names of the peaks with small-sized letters? (117) 

14. Did you abbreviate the word depression to Dep.? (115) 

15. Did you write the names of the depressions with black capital letters? (114) 

16. Did you circle the area of depressions with a thin line? (19) 

17. Did you take into account the lower height of depressions in comparison with that of the mountains? 

18. Did you color the area of depressions in yellow? (19) 

19. Did you verify whether or not you had represented depressions from other mountainous groups? 

20. Did you draw the rivers with thin blue lines between the mountainous units where they flowed in reality? (Ill) 

21. Did you write the names of the rivers with small blue letters? (116) 

22. Did you observe the direction of river flow from higher altitudes to lower ones? 

23. Did you take into account the place where each main river sprang from and where it met with other rivers? 

24. Did you write the name of the mountainous group in the upper part of your sheet ofpaper ? (120) 

25. Did you mark North with an arrow crossing the middle of the letter N? (121) 

26. Did you elaborate the legend in the lower part of your sheet ofpaper ? 

27. Did you write the title of the legend with capital letters? (122) 

28. Did you represent in the left part of the legend all the symbols you used in the sketch? (123) 

29. Did you align the symbols one below the other? 

30. Did you mention the significance of the symbols through plural nouns that began with a capital letter? (125) 

31 . Did you align the explanatory words in the legend one below the other? 


In Figure 1, what the professor realized as the four main actions (PA 1-4) has 
been emphasized; the first three were direct actions oriented towards the group and 
received by each student, while the fourth one was indirect and focused on assessing 
products during students’ absence. 

The professor realized four direct secondary actions (PA 2a, 2b; PA 3 a, 3b) that 
targeted all students with the function of feedback and feedforward through which 
she regulated teaching and learning. The professor had seven reactions to students’ 
actions (PR la, lb, lc; PR 2a, 2b, 2c, 2d, 2e). Students realized five main actions 
with the feedback function (SR 1-6) and nine secondary actions (SR la, lb, lc; SR 
2a, 2b, 2c; SR 4a, 4b, 4c). Some of the professor’s main actions were accompanied 
by feedforward (communicating the task; supervising the solution process) or by 
feedback (final assessment); others had the feedforward function (students were 
offered the checklist). The professor received silent or spoken feedback four times 
from her students; she offered spoken feedback to her students five times, and she 
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PA 1. Setting task 1 

Feedforward 

Offering: 1) oral and written 
information; 2) a model; 3) 
assessment criteria 


Al.Action 1 


Ffl Feedforward —* S|„ 


SR 1. S,. 0 Task reception and studying 
materials 

Listening to oral information. 

Studying: 1) the text; 2) the model; 3) the 
written information; 4) the assessment criteria 


I 


R Receiving silent feedback 


PR la. Receiving questions 

R Rcccivinc feedback 2 

SR la. S, Phrasing questions 


PR lb. Answering 

SR 1 b.Si nReceiving answers 

R Fb 1 Feedback —* S, 

PR lc. Fulfill 
the task 

Feedforward 


SR lc.Si n Recciving instructions 

Ff 2 Feedforward —♦ S|. B 


PA 2. Supervising task solving 

PA 2a.Primary assessment 
PA 2b. Identifying mistakes 


A2. Action 2 


PR 2a. Receiving questions 


PR 2b. Answering 


PR 2c. Offering 
new instructions 


PR 2d. Completing 
the task phrasing 


Feed¬ 

forward 


PR 2e. Asking for corrections, 
doing the products again, 
completing them, explanations for 
mistakes 


R Rcccivinc silent feedback 


R Fb 2 Feedback -* S. 


SR 2. Si „Task fulfillment 


Ff 3 Feedforward —» S ( . B 


SR 2a. S, Asking questions 


SR 2b.Si nRcccivcs answer 


SR 2c.Si n Receiving instructions 


SR 3 Si n Improving die product 


R Receiving silent feedback 4 


PA 3. Offering the checklist 


PA 3a. Offering checklist 2 
PA 3b. Offering task 2 


R Fb 3Fccdback —» S, 


A3.Action 3 
Ff 4 Feedforward —* S|„ 


A4.Action 4 

R Receiving written feedback 


SR 3aS, Correcting the product 


SR 3b S, Adding dements 


SR 3c S, Doing the product again 


SR 4.S| n Self-assessment of the product 


PA 4. Final assessment of the product 


R Fb 3 Final feedback —• S... 


SR S.Si n Prescntingi'ddivcring the 
product 


Figure 1. Professor’s and Students’ Actions in the EG (PA-professor’s action; PR-professor’s reaction; SR-students’ reaction; Fb- 
feedback; Ff-feedforward; R- reaction; S l n - all students; S x - any student in the group). 


offered them spoken feedforward four times. The students offered and asked for 
feedback, responded to the professor’s feedback and feedforward, and self-regulated 
their learning. 

The results (Table 3) show that the EG recorded a higher mean of map scores 
(M=38.20, SD=5.56) than the CG (M= 31.05, SD= 7.90), with a statistically significant 
difference, f( 118) = 5.71, p < .001, and with a large effect size, d = 1.04. Also, analysis 
proved that the EG recorded a smaller mean of map errors, (M = 3.61, SD = 2.59) than 
the CG (M = 5.98, SD = 3.76), with a statistically significant difference, t( 118)= -3.99, 
p < .001, and with a moderate to large effect size (d = -0.73). 
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Table 3 

Students ’Results 

Variables 

Groups 

N 

Mean 

SD 

Map scores 






Experimental group 

60 

38.20 

5.56 


Control group 

60 

31.05 

7.90 

Map errors 






Experimental group 

60 

3.61 

2.59 


Control group 

60 

5.98 

3.76 


Table 4 

Assessment Tool and the Results Obtained from it 


Assessment 


Indicators 


Mean Mean 
values for values for 
scores mistakes 


Difficulty coefficient 

(%) 




EG 

CG 

EG 

CG 

EG 

CG 

Mean value 









(EG+CG) 


1. Representing crests with thick 
brown lines 

1.83 

1.85 

0.05 

0.05 

86.67 

90.00 

88.33 


2. Length of crests 

3. Orientation of crests 

1.60 

1.50 

1.63 

1.28 

1.15 

0.97 

0.00 

0.00 

0.00 

0.03 

0.10 

0.25 

60.00 

50.00 

63.33 

35.00 

25.00 

21.67 

47.50 

37.50 

42.50 

1. Represent- 

units within the landform unit 

ing mountain- 

5. Representing peaks by using 








ous units 

symbols and placing the symbols on 
the crest (interfluve) 

0.27 

0.28 

0.87 

0.85 

13.33 

13.33 

13.33 


6. Representing the height of peaks 
(elevation) 

1.95 

1.60 

0.02 

0.18 

96.67 

78.33 

87.50 


7. Representing all mountainous 
sub-units 

1.78 

1.40 

0.00 

0.00 

76.67 

40.00 

58.33 


8. Representing all depressions 

1.48 

1.18 

0.00 

0.08 

48.33 

26.67 

37.50 

2. Represent¬ 
ing depressions 

9. Coloring the area of depressions 
in yellow 

1.62 

0.77 

0.17 

0.62 

80.00 

38.33 

59.17 

10. Placing depressions within the 
landform unit 

1.38 

0.75 

0.03 

0.28 

41.67 

5.00 

23.33 



11. Representing rivers through 

1.95 

1.97 

0.00 

0.02 

93.33 

98.33 

95.83 

3. Represent- 

symbols 








ing rivers 

12. Representing river flow 

1.02 

0.62 

0.20 

0.50 

21.67 

11.67 

16.67 


13. Representing all rivers 

1.72 

1.55 

0.00 

0.02 

71.67 

56.67 

64.17 


14. Names of the landforms 

1.87 

1.72 

0.03 

0.03 

90.00 

75.00 

82.50 

4. Writing 

15. Abbreviations 

1.82 

1.67 

0.07 

0.07 

88.33 

73.33 

80.83 

names and the 

16. Names of the rivers 

1.52 

1.20 

0.12 

0.18 

63.33 

38.33 

50.83 

title 

17. Names of the peaks 

1.68 

1.50 

0.05 

0.12 

73.33 

61.67 

67.50 


18. Correctness of names 

2.00 

1.82 

0.00 

0.02 

100.00 

83.33 

91.67 


19. Correctness of the sketch title 

1.88 

1.33 

0.03 

0.22 

93.33 

53.33 

73.33 

5. Editing 
elements 

20. Placement of the sketch title 

1.50 

1.12 

0.25 

0.43 

75.00 

55.00 

65.00 

21. Indicating North 

1.43 

0.77 

0.28 

0.62 

71.67 

38.33 

55.00 


22. Legend title 

1.20 

1.10 

0.40 

0.45 

60.00 

55.00 

57.50 

6. Realizing 

23. Inclusion of all used symbols 

1.20 

1.12 

0.35 

0.35 

55.00 

46.67 

50.83 

the legend 

24. Representing symbols 

1.17 

1.05 

0.35 

0.35 

51.67 

40.00 

45.83 


25. Explanation of symbols 

1.20 

1.12 

0.35 

0.35 

55.00 

46.67 

50.83 
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In analyzing the mean values according to indicators, the EG’s significantly 
better results for 21 out of the 25 indicators from the assessment tool (Table 4) are 
emphasized. Both groups had low mean values for the criterion of elaborating the 
legend. The lowest and the highest mean values for the mistakes were for the indicator 
representing the peaks by using symbols and placing the symbols on the crest. The 
EG had a mean of 2 for the correctness of names, and the CG had the highest mean 
value (1.85) for representing the crests. The EG had a mean value of 0 for eight 
indicators, in contrast to the CG whose mean values were all above 0. 

In the sketch maps in Figure 2 (all of which contain some mistake or deficiency), 
the mountain peaks are represented near the crest, thus showing that students did not 
have correct representations of the peak and interfluve. In F igure 2b, the representation 
of the river flows of the Vi§eu and the Iza between the crest and the depression is 
proof that the respective student did not know the significance of these concepts nor 
the fact that water flows to the lowest elevation point located within the depression. 

Discussions 

Next, the professor’s and students’ actions in the EG are analyzed and interpreted. 

PA1: Communicating the Task and Objectives; Motivating Students for the Activity 

The professor’s action had the function of a command (she mentioned what the 
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doer should do) and of instruction (she offered information meant for knowledge 
achievement). It was accompanied by feedforward (Ff 1), which consisted of offering: 
the model sketch, certain instructions, bibliographical information, description of work 
stages, and assessment criteria. This action was followed by three responses as a result 
of the received feedback (students’ actions and self-observations [PRs la, lb, lc]): 
listening to students’ questions (receiving Feedback 2), answering (R Fbl; offering 
feedback), and students’ oral completion of the task using feedforward (Ff 2) in order 
to increase the degree of success for solving the task and to avoid space representation 
errors. The higher the students’ competence level for solving the task was, the less 
information the professor offered through feedforward at the beginning of the activity. 

SR 1: Receiving the Task, the Feedforward and Studying the Materials 

The students’ main reaction was positive and followed by positive secondary 
reactions with the aim to fill in the gap between the information needed to solve the 
task and the information offered in the task text. They studied the task, model, map, and 
written information in the course text book while asking their professor or colleagues 
for help. Related to the task, the students offered feedback to their professor in the 
form of questions (SR 1 a) in front of all their colleagues, running the risk of receiving 
negative feedback or being ignored. Their questions were proof that students did not 
have the competence to elaborate sketch maps, that they had deficiencies related to the 
map components, and that they needed the professor as a source of specific infonnation 
about their performances, thus confirming Pajares and Graham’s (1998) assertions. 

Student feedback occurred: in the moment; upon request (Hattie & Timperley, 
2007), it was clarifying, direct, spoken and individual; negative (Murtagh & Baker, 
2009); corrective (Mori, 2011), because it indicated that the task text was not complete 
enough for the students to understand the task itself; and also positive, as students had 
asked for information because they were motivated to solve the task (Irving et al., 
2011) and because the questions’ tone and content did not disturb the initial positive 
learning environment (Koen et al., 2012). Peer and student feedback was confirmed to 
be no less reliable or valid than professor feedback (Topping, 201 0). The students had 
two positive secondary reactions: they listened to professor’s answers (SR lb) and 
instructions (SR lc); for some of them, the instructions had a feedforward role. Even 
if nine more new commands had been offered, they could not have been correlated to 
the actual indicators, which aimed to complete the infonnation in Task V1, nor could 
they have helped students to realize a better quality product. Still, the text of the task 
did not include all the necessary pieces of information for the student to solve the 
task in the best manner. In conclusion, it is difficult for professors to anticipate and 
always include all instructions in the text of a task that are necessary for all students 
to be able to solve that task. 


838 



Dulama, llovan / How Powerful is Feedforward in University Education? A Case Study in Romanian Geography... 


PA 2: Supervising the Task Solving 

Supervision focused on students’ actions and their products during the execution 
process. Students’ unconsciously transmitted, non-verbal feedback was received as a 
response to the requirements, and this was important for establishing and maintaining 
the relationship with the students (Koen et al., 2012). Thus, aspects related to the 
solving/leaming were identified: not comprehending the task or instructions, 
knowledge deficiencies, difficulties, order of performing the operations, or work 
flow. Through internal feedback, unforeseen issues became clear (e.g., the students 
did not know how to draw the main crest of a mountain). 

After looking at the sketches and after performing an on-the-spot assessment, 
several mistakes were identified: representing the mountains by means of drawing 
lines around the main peaks; writing mountain names perpendicular to the main 
peak; writing river names in black capital letters, and so on. By asking students 
and noticing their work process, the causes of several mistakes were discovered: 
wrong interpretation of the task; knowledge deficiencies; inattentiveness; wrong 
model transfer; taking the model from the map instead of from the model sketch; and 
deficiencies in the model sketch. 

Students were observed to behave differently towards the task, and the formative 
intervention was adapted towards their behavior. According to the correctness of 
their actions, which were visible in their sketch maps, two categories were identified: 
correct actions and incorrect actions. Students who performed correct actions needed 
confirmation, and they were offered positive feedback; the ones who performed incorrect 
actions needed help in rectifying them. According to their behavior during task solving, 
students were grouped into four categories: (a) Students who understood the task, knew 
what to do, how to solve the task, and solved it correctly, but possibly needed positive 
feedback; (b) students who partially understood the task and asked for the professor’s 
help; (c) students who partially understood the task and asked for their colleagues’ help; 
and (d) students who partially understood the task but did not ask for any help. 

After paying attention to the students’ actions that required support, the professor 
had five reactions (PR 2a, 2b, 2c, 2d, 2e) for regulating teaching and learning: listening 
to questions, answering, and offering instructions (first to draw with a black pencil, 
then to use color; to use the correction pen); completing the task text; asking for 
explanations of their mistakes and correcting mistakes; revising or re-doing the papers; 
and increasing work flow. Oral feedback was used “as a communicative learning tool 
intended to communicate problems and suggest ways to correct mistakes” (Koen et al., 
2012, p. 236). Corrective feedback in front of the seminar group (re-delivered feedback) 
was preferred to individual feedback so as to emotionally protect those who had made 
mistakes and also so that all students would hear it. Making students feel “devalued” 
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from negative feedback (Murtagh & Baker, 2009, p. 22) was avoided. Because 
“feedback can have either positive or negative effects on students’ motivation and self¬ 
esteem” (Brown, 2004, p. 84; Koen et al., 2012, p. 236), a friendly tone, empathetic 
feedback language, and encouragement were employed in order to have students 
realize the needed changes without having negative feelings. Effective feedback, which 
was described by Fink “as FIDeLity feedback (frequent, immediate, discriminating 
and delivered lovingly),” should be descriptive and non-judgmental to guide students 
in learning and to reflect on their learning process (Fink, 2007, p. 15). Feedback “on 
learning and not on the person,” as Wiggins suggested (2004, p. 2), was focused on. 
Therefore, the supervision was accompanied by oral, frontal, prompt, corrective, and 
constructive feedback that was specific and appropriate to students’ needs. 

The role of transmitted answers and instructions differed from one student to another. 
For the ones who made mistakes, interventions had a feedback function; for the ones who 
did not realize the actions that interventions referred to or who had not asked for help 
but needed the respective information to avoid making mistakes, interventions had the 
feedforward role, as suggested by Goldsmith (2008). Feedforward was offered either when 
it was unasked for but deemed necessary after noticing students’ work manner during task 
solving, or it was offered in relation to some of their questions. The feedforward was frontal, 
direct, and verbal. It was specific and concrete because it correlated to the task content and 
offered the information needed to ensure the correct solution, to avoid mistakes, and to 
increase work efficiency and product quality. It was simple and clear because it proposed 
simple actions. It was constructive (for development) because it focused on forming and 
developing each student’s competence to elaborate sketch maps. It was positive emotionally 
because it displayed confidence in students’ task solving, even if some students blamed their 
lack of talent for drawing. It was confirmed that “using language in a feed-forward way can 
make a significant difference to students’ ultimate achievemenf ’ (Koen et al., 2012, p. 237). 

In order to avoid the danger where “students may not listen or be distracted or forget what 
was said” (Koen et al., 2012, p. 236), they were checked to have received the corrective 
feedback and the feedforward, as well as whether to have responded appropriately. 

SR 2: Solving the Task 

Students had three secondary reactions (SR 2a, 2b, 2c.) related to task solving: 
asking questions, receiving feedback (answers), and receiving feedforward (new 
instructions). They asked six questions that focused on cartographical details (i.e., 
How thick/long should the lines be for representing the mountains? Should the 
lines be straight or a little curved? Where do we place the title?), and they indicated 
problems in selecting information from the map (i.e., what rivers/neighbors should be 
represented?). The students who received feedforward accepted the instructions and 
did not make the same mistakes as their colleagues already had. 
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SR 3: Improving the Product 

The students who had made mistakes received and accepted feedback as a result 
of three secondary reactions (SR 3a, 3b, 3c) through which they self-regulated their 
learning: they corrected their mistakes, they revised their paper, or they re-did it. 

PA 3: Offering the Checklists, as Feedforward Tools 

At the end of the activity, Checklist 1, which had been elaborated before the 
respective activity, was offered to them by way of e-mail. To sum up, it is difficult 
for a professor to elaborate on a checklist what to offer students that includes all the 
necessary information to perfectly solve a task, because the chances of identifying 
all of the problems that students will cope with are low. In order to increase learning 
efficiency and product quality, the feedforward tools that professors use during 
learning activities need an improvement approach after the activity, depending on the 
learners’ competence levels and needs. 

SR 4: Self-assessment of the Product 

At home, students assessed their products using Checklist 2. Because the self- 
assessment activity was not supervised and students’ use of the checklist was not 
researched, no observations can be made about this activity apart from the sketch maps 
that were received. Because students from both groups had difficulties representing 
mountain crests, depressions, and rivers, the checklist was concluded to be unable to 
entirely guide students in their representation of the respective elements and unable 
to replace all of the professor’s interventions. 

SR 5: Students’ Product Delivery 

Students handed in the sketch maps at the end of the term. This is also called the 
task-solving delivery. 

PA 4: Assessment of Products 

In the students’ absence, the assessment tool was used for this. In previous studies 
(Osaci-Costache et al., 2013; Osaci-Costache et al., 2013a, 2013b; Osaci-Costache et al., 
2015), analytical grids had been tested for assessing students’ mistakes and competence 
levels. In the current research, the grid had been conceived for the purpose of showing 
most objectively the manner of representing a relief feature in a sketch. Although for 
statistical processing and for the professor’s ease of assessment, dichotomist grading 
(right-wrong) would have been more appropriate, scoring from 0 to 2 (2-correct; 1 - 
partially correct; 0-incorrect or absent) was offered for each indicator because of their 
correlation to several elements represented on the map. Even though assessing a sketch 
map using this tool was more tune consuming for the professor, which could discourage 
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other professors from using it, it is an efficient guiding tool for realizing the product and 
for self-assessment, as judged from the students’ perspective. 

The significant differences between the two groups proved the efficiency of the 
professors’ direct intervention in student activity and the efficiency of the checklist. After 
analyzing the CG students’ results that were obtained from this tool, they were noticed 
to have had greater difficulties in representing the position and features of geographical 
elements (rivers, depressions, mountains, etc.) and smaller ones when writing names 
and titles. The fact that the students in the EG made many mistakes when representing 
rivers, depressions, and peaks showed us that they did not know these concepts or the 
relationships between them (i.e., between peak and interfluve, depression and slope, 
river course and altitude, etc.). The fact that the pre-university education system in 
Romania seldom has these sketches performed explains these results. 

Beginning with the observations of the EG’s activity and with assessing the students’ 
results, the questions that had been asked about feedforward at the beginning of this 
research were answered. “Who needs feedforward?” has been concluded to be the 
person who leams and solves a task or a problem and needs to organize, keep track 
of changes, and regulate learning efficiently; it is the person who should know the 
process that needs to be undergone, the features of the final product, what mistakes to 
avoid, what models to use, and so on. These persons need feedforward if they cannot 
solve the task on their own at an acceptable level. 

Taking into account its meaning, feedfa)~ward has been considered here as a 
pedagogical intervention through which one who is solving a task or learning is 
offered before any activity or action all the necessary information that can help one 
realize the given task according to expectations, or that can help one leam quickly, 
correctly, and with a minimum of resources. To be efficient, this process should be 
two-sided: feedforward transmission by the person who is giving the task (in this 
case, the professor), and the reception and assimilation of the feedforward by the 
learner (in this case, the student). 

Related to feedforward content, in order to be sure that the doer will be able to solve 
a task correctly, quickly, and with minimum effort, the person giving the task should 
offer all necessary pieces of information. This relates to: task description (what to 
do), the process of solving the task (order of stages and steps, how to proceed [what 
strategies, methods, techniques, and procedures to employ], and what to avoid doing 
in order to not make mistakes), the necessary means (e.g., tools, apparatus) and their 
use, criteria for assessing results (behavior or product), and models (demonstrations; 
correctly, as well as incorrectly, realized products). The feedforward should include 
specific infonnation about actions and their content (“Represent the mountain peak 
by uniting the main peaks with a line”) without judgments, which have a feedback 
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function (“You incorrectly represented the mountain peak”). In addition, as for when 
to give feedforward, this is thought important to do before solving the task, as well as 
during solving or whenever needed. This is in contrast to feedback, which is offered 
after realizing the task or after solving some of its parts. 

In order to create and offer feedforward, one may use several methods: enouncing the 
task, the instructions, and the suggestions concerning work style; discussing the task to 
enable students’ understanding; and dialoguing (answering some students’ questions, but 
offering this information to all students). The two-step sandwich technique (presenting 
orally or in writing a suggestion/instruction for solving the task and paying attention 
to whether or not students have solved the task according to the respective suggestion) 
and a three-step relay technique (identifying incorrect actions or mistakes in the realized 
product, specifying orally, in front of the seminar group, how to do that action correctly, 
and paying attention to whether students did or did not do the respective action and 
whether they did it correctly without making the same mistake) were used. 

As tools for providing the feedforward, the following were identified and used: 
the task text, model sketch, instructions, checklist, and assessment grid. Related 
to the task, when students were asked to “Elaborate a sketch map of the Eastern 
Carpathians,” the task was noticed to not have the feedforward function. To make 
the task a feedforward tool, it needed to describe the methodological approach (the 
stages and steps that the doers should undergo). The text of a task should be adapted to 
students’ knowledge and competence levels. The more detailed and correct the task’s 
text, the better students will understand what they should do; they will know how to 
do it correctly, quickly, and completely and will need less feedforward and corrective 
feedback during the activity. Models, including demonstrations, are important for 
learners, as these have a feedforward function if offered before the activity and are 
of good quality (i.e., correct and complete). By using them, professors may increase 
learning efficiency and product quality, provided that students understand them and 
are able to transfer certain aspects from the task-solving process to new contexts. 
Instructions also have a feedforward role when offered prior to an activity if they 
include information needed by the doer. From these, students can know how to do a 
task more correctly and quickly, and they will be able to self-regulate their learning. 

The check list may be an efficient tool for feedforward if it succeeds in guiding self- 
assessment of the product through its questions. Students who receive a detailed checklist 
are noted to be able to solve the task more correctly and completely due to the questions, 
as they can verify, correct, do again, and revise their papers. Nevertheless, checklists 
are thought to have limited efficiency. During the sketch-map assessment, students 
were noticed to be unable to correctly assess all elements because they did not have the 
necessary competence level for such an assessment. A valuable tool for feedforward 
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could be an assessment grid, if professors offer it to their students before the activity and 
if it includes assessment criteria and the indicators for each criterion. Students may use 
this assessment tool as a guide when solving tasks and realizing their products. 


Table 5 



Feedforward Categories 



Assessment criteria 

Feedforward categories 

Features 



- the stimulus is external to the receiver (doer, learn- 


External 

er) as it is realized between the source/the sender 

Direction of the feedforward 


and the leamer/doer 


Internal 

- the stimulus is transmitted among a person’s inter¬ 
nal sub-systems 


Direct 

Indirect (connected) 

- there are no intermediate links between the source/ 

Number of intermediate 
links used to transmit the 
feedforward 

sender and the receiver; it is transmitted orally 
- regulation is done through several links (sender, 
receiver 1, receiver 2, etc.) and through diverse writ¬ 
ten tools (task, check list, assessment grid, criteria, 
and indicators) 


The way in which the system 
evolution is oriented 

Negative 

Positive 

- it diminishes possible mistakes; it indicates unaccept¬ 
able features of the result or those that determine a loss 
in points; how one should not do it as it is wrong 

- it amplifies the exits; it indicates the positive features 
of the result and of the actions that need to be done 


Simple 

- it consists of instructions about simple, easy-to-un- 
derstand and to-do operations 

Proposed operation’s degree 


- it focuses on a chain of complicated operations 

of complexity 

Complex 

(selection, correlation), difficult to understand and 
which should be realized in a correct and complete 
manner by observing a certain order 


Constructive 

- of developing/increasing the potential; of clarify¬ 
ing the action and the features of the result; emotion- 

Effect on receivers 

al (being confident in ones’ success and in solving 
the task successfully) 


Stabilization 

- it enables the optimum balance (the task is solved as it 
should be, with optimum resources and with no stress) 


Individual 

- offered to a person, correlated to the task/perfor¬ 
mance of a certain person 

Number of receivers 

Collective 

- offered to a small group among other extant groups, 
correlated to the task/performance of that group 


Frontal 

- offered to a group, correlated to the task or to the 
individual performances of the people in the group 

Transmission channel 

Written 

Oral 

- through writing 

- through speaking 


General 

- instructions/suggestions that are not correlated to 
the task content; these are useless if the doer does 

Transmitted content 

Specific 

not understand the task nor know how to solve it 

- concrete; correlated to the task content; useful in¬ 
structions for solving the task 

Message clarity 

Clear 

Ambiguous 

- it offers clear, precise instructions for the doer 

- it offers ambiguous instructions for the doer 

Factors enabling its effi¬ 
ciency 

Related to the task 

Related to the process 

- it refers to the task to be solved 

- it refers to the process (the actions) that needs to 
be put into practice 
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In this research, starting with the observations and with the feedback studies, 
a series of features were identified for feedforward and were taken into account 
when realizing an original classification through which this study has filled a gap 
in the literature (see Table 5). This original classification allows for a more in-depth 
understanding of feedforward, for its use as a mechanism of increasing learning 
efficiency and product quality, and for its ability to connect with feedback. 

Some limits of feedforward are noticed to be related directly to the receiver’s 
attitude, behavior, and competence: not receiving orpartially receiving the feedforward 
(because of inattentiveness); not understanding, partially understanding, or 
misunderstanding it (caused by lack of previous knowledge; ambiguous, incomplete, 
or general feedforward); ignoring the feedforward (considering it as unimportant or 
neither reading nor studying the recommended material); not accepting it (considering 
the received information to be incorrect or inappropriate); low transfer capacity of the 
feedforward to new contexts. Towards the professor’s feedforward, students should 
manifest trust and openness, be receptive to suggestions, dare to ask questions, 
make an effort to understand the received messages, and ask for instructions from 
professors and colleagues. 

Several limits of feedforward were also observed to be caused by professors: incomplete 
or ambiguous phrasing of the task, incomplete knowledge of its solution, inability to 
anticipate possible mistakes or diversity of learners’ actions, low ability to supervise the 
activity, no knowledge about the feedforward mechanism (techniques, means, and tools), 
unsatisfactory level of communication competence, low empathy, and so on. 

Conclusions 

In activities with students, professors use both feedback and feedforward. To increase 
students’ learning efficiency and the quality of results, professors should use feedforward 
more than feedback because it creates and ensures the necessary conditions for students’ 
correct solving of tasks and because it prevents them from making mistakes. By 
using feedback, they only correct mistakes. When professors use feedforward that is 
represented by specific techniques and tools, their students solve the task more quickly, 
better, and with less resources than in situations where professors offer feedback and 
students have to re-solve the task in order to achieve the expected results. 

Students need their professor’s feedforward to improve their learning process and 
to increase their product quality. In order to offer feedforward, professors should 
know their tasks very well, their students’ features, and the characteristics of their 
results; they should be empathetic, good observers, and competent communicators, as 
well as know how to use appropriate feedforward tools and techniques. If professors 
pay attention to the activity, they will notice some of their students’ mistakes and be 
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able to use feedforward in a precise and open manner. Thus, they can help students 
avoid mistakes and will be able to check if students used feedforward constructively. 
Feedforward is a powerful tool through which professors can determine an increase in 
learning efficiency and in the quality of the university education system, even if they 
cannot use feedforward to prevent all the possible mistakes that students make. So that 
feedforward provides the expected results, it is important that the receiver receives it, 
understands it, and responds appropriately by self-regulating his or her activity. 
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